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ABSTRACT 

Effective action in educational developient is 
dependent upon an adequate consideration of requisite variety. An 
adequate consideration of requisite variety includes a delineation of 
the inforaation field appropriate for the decisionnaking system* An 
interaction of the inforiatlon doaaln vlth each state of developient 
state-set, and whole would enhance decidability. The evaluation of an 
educational systen qua organization requires the delineation, 
procureient, and provision of inforaation for th») reduction of 
uncertainty in decisionaaklng. The theoretical basis for the 
evaluation aodel derives fron a self-organizing aeta-structure of 
ontogenetic pragnatics. The self-organizing neta-structure includes a 
supra-ordinate stabilization of syntax and seaantics. Two subordinate 
stabilizations of coapletability-consistency and 
controllability-observability are eabedded^ in the self-organizing 
stabilization. The ontogenetic pragiatics include a stabilization of 
syntQl eleaents and synergistic relationships in the pragiatic 
functions of the organization. The pragaatic functions aay include 
policyaaking, needs assessaent, planning, prograa developaent, 
prograa iapieaentation, prograa evaluation, aanageaent inforaation 
systea resource nanagenent, and environmental relations. The purpose 
of the evaluation is to facilitate the inproveaent of gei^eral systeas 
decisions in educational developoent. (Author) 
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GENERAL SYSTEMS DECISIONS IN 
EDUCATIONAL DEVELOPMENT 



Brmel Stepp, Jr. 
Design and EvalXiation Specialist 
Appalachla Educational Laboratory, Inc, 
Charleston, West Virginia 25325 

Effective action in educational development is dependent upon 
an adequate consideration of requisite variety. An adequate consideration 
of requisite variety includes a delineation of the Information field appro- 
priate for the decision-making system. An adequately delineated informa- 
tion field for general systems evaluation attends to the logical duality 
of incomplotability-consistency and the empirical duality of controllability- 
observability. Incompietability provides tho definitive boundary, shifting, 
and capacity of syntality. Consistency relates the redundancy, multiplexing, 
and reliability of synergy. Controllability transforms the connectedness, 
encodability , and ambiguity of synergistic consequents of syAtality. Obser- 
vability is germane to the decipherability, decodability , and equivocation 
of synergy in adaptive syntal antecedents. Criterion variables, operational 
indicators, and acceptability levels differentiate this basis of requisite 
variety in the information universe for general systems decisions on educa- 
tional research and development* Research management neglects requisite 
variety in underdetermined planning and evaluation models. 



Educational Development 
Educational development is a systematic effort to generate and diffuse 
products to expedite human learning in institutional settings. A rationale 
for effort is strongly related to change gradients in the contemporary milieu. 
Marketability has been a salient concern with scant attention to the "world 
problematique" (Meadows, 1972) and alternative futures in evidence. Policy 
has been forged by advocacy in an arena of conflict with minimal priorities 
for the macro system, A resistance to formalization in theoretical and 
methodological adequacy is manifested in a general politicized climate of 
mediocre programs. Amelioration of this state of the art may be brought 
about by algorithmic advocacy addressed to accountability through requisite 
variety. Anything of lesser stature may be a damage-laden Intervention with 
regression consequences for the macro system and/or the human subjects (Nash, 



1973) Sprigle, 1972; Wheeler and King, 1972). 
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Tho National Institute of Education (NIB) has been organized and 
invested with a mission to nurture educational R&D. The decision 
setting for educational development may have a neomcbilistlo character In 
engendering large change in a small information field. The decision model 
for educa tional development may be that of planned change (Clark and Gubai 
1965, 1972) • A variant of the planned change paridigm guides the efforts 
of the Appalachia Educational Laboratory, lnc< (AEL) , The AEIi model sub- 
sets the domain of educational development with concomitant emphases in 
product development and product diffusion and three linear strategies! 
product planning strategy, product development strategy, and product dif- 
fusion strategy. Each strategy nests at least one of the seven-stages of 
the paradigm. The product planning strategy subsumes the stages of needs 
assessment, feasibility analysis, and program planning. The product 
development strategy subsumes the stages of design and engineering, field 
testing, and operational testing. The product diffusion strategy includes 
the state on dissemination and implementation. 

Theoretical Basis 
The theoretical basis for the evaluation of educational systems is 
the reduction of uncertainty in decision-making on the system qua organi- 
zation (Cyert and March, 1963j March and Simon, 1958) • Several levels of 
uncertainty are posited. 

• Pragmatic uncertainty pertains to mundane functions. 

• Transactional uncertainty pertains to interfacing prag- 
matic components; and the organization must realize a 
balance between pragmatics and semantics. 

^ Semantic uncertainty exists in the controllability and 

j 

observability of the system; and the organization. 



Must realise a balance between the ability to drive the 
system from given states to desired states ar.d the as- 
signment of fault for failing productivity. 

• Self -organizing uncertainty* exists in the relationship 

of syntax to semanticsi and the organise ation must realize 
a balance between the most general logical rules of action 
and meaningful control and meaningful observability of the 
system. 

• Synatio uncertainty is the inherent indeteminetncy of a 
rational system in terms of completability and consistency; 
and the organization must realize a balance between complet- 
ability and consistency. 

m Algedonic uncertainty pertains to' the lack of doubt and 
presence of confidence in the capacity for exchange in the 
syntax-pragmatics interface such that the organization may 
maintain a viability and robustness in its environment, but, 
nevertheless, respond with requisite speed to challenge. 

• Ontogenetic uncertainty exists in the relationship between 
syntali.ty and synergy in the system^ and the organization 
irtust realize a balance in complexity of elements and re- 
lationships. 

The realization of balance, equilibrium, or stabilization in the face 
of these uncertainties is the rasipn d^tre for institutional leadership, and 
infuses organizational identity and character. The reduction of these 
organizational uncertainties is the eine qua non for the evaluation of the 
cooperative qua organization. Organizational evaluation delineates, pro- 
cures, and provides information to reduce undertainty in decision-making 
about the organization. 
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Metal's true tare 

h mota<*struotur6 for the organization is evident in the uncertainties, 
A flpeolfication matrix for this mota-structure is a necessary delineation 
of the general information requirements for organizaQbnal evaluation. A 
sufficient delineation is realized when the. pragmatic functions of \:he 
system are specified, including the ontogenetics complexity of syntal elements 
and synergistic relationships (Figure 2) • Such lists of variables and taxa 
as prepared by March and Simon (1958), Griffiths et al. (1969), and Price 
(1968) may prove helpful in delineating the functions. The pragmatic 
functions may be the following j 

• Policy-Making 

• l^eeds-Assessment 

• Planning 

• Program Development 

• Program Implementation 

• Prograjn Evaluation 

• Management Information System 

• Resources Management 

• Environmental Relations 

• Self-prganlzing meta-structure . Self-organization enhances pattern 
in the faco of entropic environmental abrasion* Syntality and/or synergy 
may sin4)lify or become more complex. Let completability , consistency, 
controllability, and observability be represented in Figure 2 by points 
11, 22, 33, and 44, respectively. Let the ij points represent interaction 
carriers between the equilibria agents, A given educational system, whether 
fully stabilized in institutional character, recently formed and seeking 
identity, or experiencing a transient condition of organizational development 



r>0 
12 



14 



24 



0 



21 



0 
31 



0 

41 



32 



34 



• 0</ 
43 



44 



0 - 

42 



Figure 2 



Self-Organizing Meta-Structure 



may be ^conceptualized and evaluated for the full self-organization of 
epigenetic pragmatics (Figure 3) . 

System Logic 

Simple advocacy is necessary but insufficient for the elaboration 
of learning support systems, Educe^tional development may bo defensibly 
Constrained to modes of elaboration which are reliant upon algorithmic 
research-based advocacy (Schutz, 1973); which formulates a systems'de** 
cidability in terms of a basis of requisite variety {Ashby, 1959). The 
delineation of requisite variety in the information universe for educational 
development spans the domains of logical duality and empirical duality. 
Logical duality includes incompletemess and consistency (Davis, 1958). 
Empirical duality includes controllability and observability, A typology 
of this duality may raise questions of program logic* Most developmental 
efforts, for pretenses of political sophistication or default in coping 
ability, are probably incomplete and inconsistent. 

Incompleteness 

Incompleteness exists if the universe of propositions is not ex- 
hausted. Exhaustion may be precluded by lack of specification of system 
states and/or the failure to identify relevant state-variables, A search 
of contigencies including needs, problems, and opportunities is essential 
in the resolution of the horizons of possibilities. Neglect here may lead 
to developmental efforts with tragic consequences. Suboptimization of a 
legitimate developmental subsystem with strong advocacy and hand wagon 
allegiance may be tantamount to educational decay. Universal early child- 
hood education with -strong affective-socialization objectives could con- 
ceivably deplete society of "shy, lonely" sizothymic theoretical physicists. 
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Career ©duoation systemd c<Mil4 havd a;dahV«w«« incoi^ 
B0M ■ PJfoduotivity syndrome devaluing Creative leisure and leading to 

a crisis in a state of braking industrial'^technological growth (Nash, 1973) . 
am. Incompleteness encompasses the reflection of a logio upon .Itself 

to disclose an inadequate closure, A crack in the wall of the autononvous 
composure of a predicate calculus for aotion is persuasive of justifiable 
permeability or completion from without (Beer, 1959) . The universe of 
criterion variables in the design calculus is subject to strategy shiftingi 
elimination, combination , transfer, modification, and simplification. 
(Operational indicators are characterized by the same reservations t tactical 
shifting (appropriate for formative evaluation) . Acceptability levels for 
planning decisions concern channel capacity and boundary shifting. A funda- 
mental planning decision based upon incompleteness information Is in terms 
of a criterion of maturity. What conditions and circumstances emit the 
predication of a "mature Educational Laboratory" or "mature Educational 
Cooperative"? 

The formulation of objectives constitutes a planning decisions subset 
relative to any development system. The delineation, gathering, and pro- 
viding of information to fund planning decisions is context evaluation. 
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Basic Development Logic 
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This information pGJTtatns to intended ends 6£ the product, The principal 
issue is incompletedness requiring strategic shifts in the goal-structure 
of the design. A functional closure may be certified to be embodied iji 
the design as well as engender a repertoire of strategic shifts. 
. Educational output is monitored by the educational development 

system (EDS), m the output apace, V, educational problems are identifiable. 
Which actions are to be taken to produce desired consequences? a casual 
relationship is predicated between a desired criterion effect, such as 
remediating an undesirable educational deficiency, and causal predictors 
or control decision variables. The control decision problem may be (],) 
stochastic risk, (2) deterministic certainty, or' (3) judgmental uncertainty. 
Por each decision control problem the monitor-identity function generates 
a criterion universe of concern for the EDS and enumerates the criterion 
elements. Implicit remediation actions are predicated for the search for a 
solution to the educational problem. 
Consistency 

, Consistency in educational development encompasses state succession. A 
next-state mapping function describes the state transitions in the system 
as a form- of law of interaction among states. 

X(t) « ^ (t,to) Xo 

X = n state vectdr 

XoB n initial state vector 

4)(t,to)= state-transition matrix 
An-aspect of succession is persistence, including sinks. Consistency pro- 
vides pattern which enables choice in reconsidering incompleteness and 
structuring the system. 

Choice involves criteria and decision rules, criteria provide standards 



as a basis for choosing among altomatlvs aottons. Tfie drlteria may be instru- 
menUl or consummatory » or, soientlfio or prudential, strategies for action 
contingent upon levels of risk on criterion variables may facilitate choice 
In some decision frameworks. 
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Figure 5 

Educational Ucvelopwent: 
State**Space Representation 



Priority . Elements of the criterion universe of concern are ordered 
in a decision-making hierarchy. Given the finite family of criterion systems, 
Y, Yi, and i e I, i > j iff has priority of action over Y j , where > denotes 
ordering in I, therefore, 

Yg > Y^ > > Yj^ < ...> Y^ 
represents the complete ordering of m elements in the criterion universe. 

Standards . For each criterion element a metric comparison may be chosen 
to demarcate the boundary between satisfaction and dissatisfaction, including 
lower bound, upper bound, and latitude. 

A minimum standard does not mean the smallest number, but may be an upper 
bound, for example. A goal may be a more explicit numerical identity not in 
the boundary set. 

performance Index . The fundamental choices of system synthesis pertain 
ErJc systems performance index. T!he performance index is a function which 
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is miniwisied to ach^ove l^ast initial error, instantaneous error, and cost- 
of-control in the operation of the system (Ogata, 1067). Itie criteria and 
decision rules for specifying the perfcrmance index of the system are crucial 
choices of character. The selection of state variables and the weighting 
criteria in the matrices of error and cost are very weakly expressed in most 
development systems, if not left emergent by default. Herein resides a cen« 
tral concern of feasibility analysis. 

J "* + -^21*6^1 <^it + /u*Ru dt 

J " system perfomance index 

X w state-vector (column) 

x*tt state-vector (row) 

P « initial error weighting matrix 

Q » instantaneous error weighting matrix 

u o control-vector 

u*a control-vector 

R ta cost of control matrix 

Discretion of the continuous equation would be appropriate for sampled 
data systems. 

, Structuring decisions . System structuring decisions influence state 
succession and persistence through redundancy, multiplexing, and reliability. 
Redundancy is multiple causal connectedness such that an Influence may be 
exerted over alternative channels. Multiplexing is the refraction of single 
influences upon more than one criterion variable such that each criterion 
variable is an interactive combination of influences. Reliability is the 
certainty of effect from structuring action. Oliese issues constitute the 
central concern of program planning. 

Alternatives . A priority concern may be a composite causal effect of 
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/ ddoislon vairlablest A 8,ot of decision variables couia constitute a weighted 
linear combination to determine the criterion, 

" More explicitly^ decision variables may be weighted in coittoinations to 
' obtain decision alternatives for the solution of the problem involving a 

high priority educational criterion, 
\ A vector-matrix equation may simplifyi 

' Tho multivariate planning matrix ifif conventionally formulated by the 
planner in terms of strategies and actions. Under stochastic risk the matrix 
elements are probabilities! under deterministic certainty the elements are 
numerical weighting coefficients ; and under judgmental uncertainty the ele- 
ments are relative valuations of the action states, ilie multivariate plannt;)Lng 
matrix is communicated to the decision-maker. / 

Decision . A decision problem is to choose a strategy of action from a 
set of alternative strategies. 

A complete paradigm of the decision-making process involves certainty^ 
risk, and uncertainty. Decision under certainty involves the selection of 
strategy with optimum payoff. Decision under risk involves the selection 
of strategy with the highest expected utility* Decision under uncertainty 
involves the selection of a decision rule and the selection of a strategy 
with payoff best meeting the decision rule. 

# Tv;o players may find a saddle point in a game such that each 
minimizes his losses and maximizes his gain. This is the 

game-tlieoretic minimax solution. 

I 

# Deterministic optimization involves an objective function and 
a feasible domain of allowable decisions. The objective func- 
tion is a composite of an outcome function and an evaluation 
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funotion« The outcome function maps aotions into criterion 
ef foots. Tho evaluation function maps the interaction of. 
action and criterion into a value set* ahe deterwinistic 
optimization problem is to find deoisive actions in the 
feasible domain such that the feasible objective function 
values become less than or equal to general objective func- 
tion values . 

# A stochastic efficiency matrix is important in decision under 
risk. A strategy may have a probability given in generating 
a certain outcome • 

Aoki (1967) has generated some conceptual structure on the 
optimization of stochastic systems compatible with mathemat- 
ical control theory, 

■ 

# The best of the worst, a pessimistic solution, is opted for 
under the premise of maximin utility. In the multivariate 
planning matrix, the minima of the rows are identified^ and 
the smallest maximum of these is used to select ^e row 
strategy for action, 

# The best of the best, or the optimistic solution, is opted for under 
maximax utility. That strategy ^ which simultaneously maximizes the 
value element is chosen. 

# A weighted choice on the optimism-pessimism dimension is made in 

which that strategy. Si, is selected which maximizes (ctmax Vjj + 

(1 -o> V.a) in the Hurwicz rule. The symbol a has a numerical 
» j ^3 

value given by 

0 <0L<^1 

such that a « 0 ^ 'the pessimistic maximin, and a « 1 « > the 
optimistic maximax. 
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• That strategy, S. , is chosen from. the set of alternative strategies, 

n n 

S, such as to maximize S v.., or t V^j/n the mean values in the 

j-1 i-^l 

La Place rule. 

♦ A satisfaction problem involves an objective function^ a tolerance 
function, a feasible domain of allowable decisions, and arbitrary 
sets. Letting X. and Q be arbitrary setsi 

gi X K fi--^ V (objective function) 
"Vt ft*^ V (tolerance function) 
TfhB problem is to find a satisficing solution 5 e X^c X, w e ft 
g (X, w) <^ "V(w) 

The satisficing criterion is represented by <. ihe satisficing 

problem is represented as (g, r, X^, Q ) . 

1 

System Dynamics 

The empirical duality of controllability and observability ar^ crucial 
to the explication of system dynamics* Controllability exists if the system 
can be transferred from an initial state to a goal state by a finite control 
sequence in a finite time interval* Observability exists if a prior state 
may be inferred from a finite output sample in a finite time interval* The 
state-space of an educational development system may be decomposed into four 
cells according to the presence or absence of controllability and observa- 
bility (Ogata, 1967) Shultz and Melsa,s 1967) . 
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Any system may partitioned Into sumultaneous subsystems under con- 
trollabllity-observabiiity schemata. Accountability may exist 
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Figure 7 

Controllability-Observability Partition 
only under conditions of simultaneous controllability and observability* 
The subsystem is an unresponsive cell to any control vector • The S^^ 

•.C CO. 

sybsystem is a fully accountable partition. The subsystem is an autono- 
mous emitter of influence not strobed by the control signal, S is a non- 
reactive subsystem which may be necessary for the interactive capacity of 
the system. 
Con trol labil 1 ty 

Controllability exists if the system can be transferred from any Initial 
state to any final state in a finite time interval by a finite control 
sequence. Symbollically , 

A linear vector-matrix variation has the following formi 

X a A X + B U 

X " state variable vector 
u a control vector 
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A to transition matrix 
B w control matrix 

Goal- attainment includes yieldp and the state-apace representation gives 
an output vector as a function of state variables, control vector, and time/ 

A linear vector watrix variation has the following formt 

Cx + Du 
^ «' output vector 
X " state vector 
u ft control vector 
C w output matrix 
D " transmission matrix 
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Figure 8 
State-Space System 
Strategic effects are to be noteds 
# Certain state- variables could be associated with large coefficients 
such that a small change in the state- variable would engender a 
large effect upon a rate of change in that state variable or another 
one. The manipulation of such a variable in an educational develop- 
ment system may contribute to cost-effectiveness, for example, 
o Alternative trajectories may be identifiable from the origin, or 



an interim etato to the final state, Undei: equi finality the optimal 
trajectory can bo seloctod for economy of development, 
0 A stationary state existSi if X - 0/ and development may be impossiblo 
and if tried a wasteful quandary i another selection of state-variables 
may not have a vanishing vector derivative and allow a developmental 
decidability for positive action « 

• periodic fluctuations, nodes, loops, and cycles may describe the 
development trajectory under certain circumstances and be difficult 
to interpret aside from a quantified systems model of decidability 
in educa^-ional development. 

• A sigmoid curve of growth-like or decay-like phenomena may occur 
in some development systems, especially in diffusion subsystems. 

• Independent subsystems may emerge, and even tend toward conditions 
of suboptimization. 

• State-variables may have, hierarchical order, akin to fundaments, 
first order factors I and second order factors* 

p The impulse-response function may indicate the most cost-effective 
strategy for controlling system-states and effecting output yield. 

• What is the system response to one unit change in each state- 
variable in strategic states? 

The manipulation of state-transition sequences, or next-state mappings 
is consequent upon implementation decisions based upon information about 
implication, connectedness, and transformation. Such information is desig- 
nated controllability information. The operational indicators, subject to 
formative search and manipulation, may be principal shape rs, preventers, and 
encodable affecters. A manipulatable indicator may have an impulse- response 
function relative to its including criterion subsystem, and this impulse- 
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response controllability information may reduce the uncertainty attendant 
to effect* Acceptability levels on criterion variables involve the per- 
formance index relating terminal error, instantaneous error, and control 
costi satlsficing boundaries (or optlmiaing maxima) i and ambiguity. 
Ambiguity is the uncertainty of the output given the Anpat, 

Means and actual effects are coupled in implementing decisions on 
the system. Concern is for program operations. The delineation, gatlaer- 
ing, and providing information to fund implementation decisions pertaining 
to each of the manuals is process evaluation. The principal issue is con- 
trollability; that is, the problem is the manipulation of states to generate 
a transition sequence to create consequent target states, The design and 
engineering state invests the state-space system with substance, that is, 
elaborates a realization of syntali'ty. 

Once en acceptable coping strategy has been selected, the boundaries 
of action must be demarcated for each program. . Implementation of the Solu- 
tion is rudimentary mapping of action elements, Xj^^, and their uncertainties 
U, onto Yj^, i.e. P: X X U -^-Y. The real mapping of the enabling variates 
onto the education criterion variate is in the utilization of products by 
adopting educational systems. 

Ob servability 

Observability information is delineated, gathered, and provided 
to make recycling decisions. The decipherable operationality of criterion 
variables is a matter of concern. A criterion construct must be subject 
to ascertainment. A criterion event must be witnessable. Aaitecedent 
states must be inferable from a finite output sample. Operational 
indicators must have decodable effects to subserve fault assignment in 
convergence policies. Acceptability levels for criteria of success 
would include attention to fail-safe and equivocation. Pail-safe 



20 

♦ • ' ' ■ ■ 

dn$urd$ safety due €o varning dyatem failure « Equivocation ie uncertainty 
of input givcjn the output ♦ • , 

Reoyoling deoisions on the products of a development eys tern constitute 
a congruence judgment between actual realization and ends, that is between 
consequent and consummatory states. The delineation, gathering^ and provid- 
ing of information pertaining to recycling decisions is product evaluation. 
The principal issue is observability) that is, the problem is the identifica- 
tion of antecedent states from an observation of outputs over a finite time 
interval. Field testing in the educational development paradigm has this 
central concern of product development strategy; operational testing shares 
the emphasis on controllability, but primarily for the benefit of potential 
adopters. Woreover, operational testing confronts the adopter with the issue 
of whether the educational development product does, indeed, provide an 
adequate situational decidability, 

Observability may subsume the behavior such as March and Simon (1952) 
identified in an adaptive purposive system and related by Stepp (1972) to 
formative evaluation in educational development. 

• Greater search is a consequence of less satisfaction. 

• Higher expected value of reward is a consequence of greater 
search. 

• Greater satisfaction is a consequence of higher expected value 
of reward* 

• Less satisfaction is a consequence of higher level of aspiration. 

• Higher level of aspiration is a consequence of higher expected 
value of reward. 

• A stable equilibrium with aspiration exceeding expectation is 
implied by constant aspiration. 
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• A search proportional to expectation is implied by a constant 
oxpoctatlon« 

* A search threshhold residual is a consequence o£ the equality 
of aspiration and expectation. 

e Cessation of search is a consequence of the equality of satis*^ ; 
faction with a certain multiple of the residual search. 

Requisite Variety 

Theoretical inadequacy is the selection of an inappropriate strategy* ^ 
A strategy is a repertoire of variety and manipulations to influence payoff 
in a contest, for stakes with an opponent (Ashby, 1956), in the sense of 
cybernetics » A strategy may include extraneous >;ariety or exclude relevant 
variety and be characterized by theoretical inadequacy* "The case of extra- 
neous variety is a lack of parsimony, a redundancy not preventive of stra- 
tegic validity. Strategic validity is the extent to which the transmitted 
influence of variety is the intended Influence* The exclusion of relevant 
variety from a strategy may prevent strategic validity from being attained, 

Theoretical inadequacy is crucial and justifies an intensive search to 
preclude a premature closure on criterion variety, elements of satisfaction 
with realization in reference to the design model. Ashby's principle of 
requisite variety states that variety can be driven down only by variety in 
the control or regulator (Ashby, 1956), Haberstroh (1965) has given this 
principle a high recommendation for organizational design/ The control of 
realization requires a repertory of variety large enough to squelch noises 
and disturbances* 

An autogenetici self-organizing developmental system may be subjectable 
to tSttdecidabiltty through improper attention to requisite variety* For 
edqaltiM&Pd systems, this could be tantamount to forfeiture of 

^ th0 cottipietion-from-without whi<:h is so crucial to the metalogtc 6l the 
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morphog^nosiat Of devolopinent systomsi Oh^ vairiety must bo permlaflive of 
mappings of chaieaotdristlo confutable functions translating micro policy 
and the states of education development into macro realization! The 
delineation of requisite variety for general systems decision in educational 
development is represented in Figure 9. ^ 

An evaluation plan prescribes the identification of decisions, the 
delineation of information, the procurement of information^ the provision 
of information to decision-makers, and the allocation of resources to execute 
the plan. Of course, requirements for formulation of the plan, and monitoring 
the utilization of evaluative information in decision-waking should be met. 
A flow chart would facilitate the implementation of the plan according to 
a Schedule of events and activities, 

Identify pecisions 

The general decieion field is the self-organizing meta-structure of 
epigenetic pragmatics* The syntality and synergy of the pragmatic functions 
are to be doterminedi the system stabilization of syntax and semantics is 
to be determined for a base case; and alternative models for organizational 
development generated. 

Dolineate Information 

Delineate the specific syntal elements and synergistics relationships 
of the pra^jmatio functions for the given cooperative/ Require information 
on semantic stabilizacion, syntactic stabilization^ and self-organizing 
stabilization of the ontogenetic pragmatics of the given cooperative for 
the base case^ and lateraative models for organizational development. Require 
a demonstration for the given cooperative tHat sislf«^6rganizing Stabilization 
'^11 iSMaMt^^ and transactional Stabilization, 

ii^pOSSibie. 6therwlle; Ixptld^^^^^ o? ovigenetic stabiilialioh 
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and tranaaotlonal stabilisation* v 

^^^^^^^^^^^^^^ V bo a reciprocal exchange between 

the evaluator and the decieion-waker • The evaluator should monitor the 
Jutili^ati<^n of evaluative information to assess its impact and worth, 

Procure t n formation 

Data procurement involves instrumentation and data processing j informa- 
tion procurement involves the transformation of data into decision-relevant 
messages, • ' • ' * 

Instrumentation , idantify or design instruments to obtain data on 
each syntal element of each pragmatic function over a specified time. 

Obtain and administer instruments to gather data on each syntal ele- 
ment of each pragmatic function over a specified time* 

fi^ta Processing , Code a^d store data for retrieval, Provide for 
editing and quality control of data, Assure that suitable hardware and soft- 
ware computer facilities are accessible for the transformation of the data to 
decision-making inf<?rmation, 

Methodology , Analytical and synthetic techniques for the generation 
of decision-referenced information are to be identified and scheduled* 
Different techniques are more applicable to certain meta-structural data 
than others, suggested methodological choices are indicated in Figure 10, 

Prpyisipn of Information 

Informant ion should be reported to decision-makers In a style consonant 
with their ne^ds, one report should very simply indicate tlte contribution 
of each variable to the pragmatic function) the roles of the pragmatic 
lurtct^ In Institutionai character, sense of Identity v and organlsiational 
autonomy) and what can be done to Improve the educational cooperative qua 
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okganiKatlon. least one technical report should be prepared to treat 
th$ theoretical and methodological problemd In any given evaluation* 

Sunwary 
ft 

An infomatlon dotnaln, adequate tot systetos decidability, may be 
subsetted with completeness^ consistency! controllability, and observa- 
bility* One dlfferentiatloh of requisite variety for general systems 
decisions Includest system-states, state-variables, state-succession, 
system performance index, control signal, output, cent, error, and time* 
A specification of such a set of requisite variety constitutes a loglco- 
empirlcai basis for algorithmic advocacy of educational development and a 
justification for an allocation of accountability. An Interaction of the 
information domain with each state of development, state-set, and whole 
would enhance decidability. 

•Jhe evaluation of an educational system qua organization requires 
the delineation, procurement, and provision of information for the re- 
duction of uncertainty in decision-making.. The theoretical basis for the 
evaluation model derives from a self-organlaing meta-structure of ontogenetic 
pragmatics* the self-organising meta-structute Includes a supra-ordlnate 
stabilization of syntax and semantics * Two subordinate stabilizations of? 
completability-oonsistency and controllability-observability are embeddeci 
in the self-organizing stabilization* Ihe ontogenetic pragmatics include 
a stabilization of syntal elements and synergistic relationships in the 
pragmatic functions of the organization* The pragmatic functions may 
include policy-making, needs assessment, planning, program development, 
program implementation, program evaluation, management information system 
resource managemdnt , and environmental relations * ihe purpose of the 
evaluation Is to facilitate the improvement of general systems dfici^ions 
in educational development* 



I 



BIBLIOGRAPHy 



ERIC 



28 

BULLlOORAPm 

A.lper, Paulf ^'Introduction of Control Concepts In Educational Planning 
Models," Mathematical Models In Educational Plannlng t Paris i Organi- 
zation for Economic Cooperation and Development, 1967# 

Andrew, Gary M, and Donald E, Moir. Information - Decision Systems in 
Education . Itasca > Illinois i Peacock Publishers > 1970* 

Anthony, Robert N» Plannin;^ and Control Systems| A Framework for Analysis ♦ 
Bos ton : Harvard Business School, 1965V ' 

Aokl, M. Optitnizations of Stochastic Systems > New York; Academic Press, 
1967. ^ 

Apter, Michael. Cybernetics and Development . New York t Pergaroon Press, 
1968. 

Archibald, R. and R. ViUoria. Network Based Management Sys terns « New 
Yorki John Wiley and Sons, 1967. 

Armitage, Peter M. , Cyril S. Smith, and Paul Alper. Decision Models for 
E ducatioaal Planning ^ London: Penguin, 1969. 

• Models for Educational Decision Making . London J Penguin Book 



ERIC 



Company, 1969. 

Aflhby, W. R» An Introduction to Cybernetics . New York: John Wiley and 
Sons, 1959. 

Beer, Stafford. Cybernetics and^ jlanagenient . New ^oirk \ John Wiley and 
Sons, 1966* \ 

.. . . . D ecision and Control . Londont John Wiley ind Sons > 1966*^ 

Bellman, Kt chard. Adaptive Control Processes' i ' Princeton, New Jersey i 
Princeton University Press, 1961. * V 

Berrien, Kenneth F. General and Social Systems * New Brunswick: Rutgers 
University Press, 1968. / 

Bertalanfly, Ludwig von. Goneral System Theory . New York J George Bray^* 
iller, Inc. , 1968. r 

"General System Theory - A Critical Review,*' WaJfer Quckley 
(cdV) , Modern Systenig Researeh for the Behavioral Sctent i sts ♦ Chicago \ 
Aidlne Publishing Cotfipany, 1968. 

Bertram, Charles L- '-The Application of a Model for the Evaluation of 
Educational Products." A paper presented at the annual rteetlng of the 
American Educational Research Association, New Orleans, Louisiana^ 
t^cbruaiyi 197^ 

fcobth i Taylor L. Sequential Machines and Automata Theory . New York ! John 
O / Wiley and Sons, Inc., 1967. 



29 



BrftybrookA, D. and C. E. Undbloro. A Sttat^Ry o£ DacUlon . New Yorkj 
Free Press > 1963. / 

Brosa, Itwln D. F. De st&n for Decision . New Yorkj Free Press, 1953. 

Broudy, Harry. Criteria for the Theoretical Adequacy of Conceptual Frame- 
work of Planned Educational Change . Bethesda, Marylandt ERIC, 1965. 
(ED 010 914) 

Rrowder, Jr., I^sley H. Emerging Patterns of Administrative Accountability . 
Berkeley, Califomlaj McCutchan Publishing Corporation, 1971. 

Buckley, Walter (ed.).' Modem Systems Research for the Behavioral Scientist . 
Chicago! Aldine Publishing Company, 1968. 

Sociology and Modern Systems Theory . Englewood Cliffs, New 



Jersey! Prentice-Hall, Inc., 1967. 

Campbell, Donald T. Exploration of Novel Research Designs and Measurement 
Techniques . Evanston, Illinois t Northwestern University, 1965. 
(ED di3 369) • . 

Campbell, Merrill 0. et al. Directions for Educational Development in 
Appalachia . Charleston, West Virginia: Appalachla Educational 
taboratory, Inc., 1971. 

Center for Effecting Educational Change. Evaluation and "PACE" » A Study 
of Procedures and Effectiveness of Evaluation Sections In Approved 
• PACE Projects with Recommendations for ImptovemeiTt . Report iH of the 
second National Study of PACE. Fairfax; Virginiaj Center for Effect- 
ing Educational Change, 1968. 

Clark, David L. and Egon O. Cuba. "A Jte-exafldnatlon of a Test of " the 

'Research and Development Model' of Change.'"' Educati onal Adminlstra- 
; tlon Quarterly . 8(3) 193-103, 'Autumn, 1972. 

Clark, David L. and Egon G. Cuba. "An Examination of Potential Change Roles 
In Education," Rational Planning in Curricul um and In struction , Washing- 
ton» National Education Association, 1967,' pp. 111-133. 

Cook, Desmond L. Management Control Theory as a Context for Educational 
Evaluation . Columbus, Chios The Ohio State University Educational 
Program Management Center, 1970. 

__. "Management Control Theory as a Context for Educational Evalua- 

tlon." Journal of Research and Development In Educatlon > 3(4)j13-26, 
SuroiQer, 1970. 

Crdft, bon ft. and Adolph J. Kocntg (editors). Application of Research 
Management Tochnlgues . Las Cruces, New Mexico J Special Interest 
.Of60}> on Research Management, New Mexico State Uniyerslty, 1971. 



ERJC 



30 



Curbie^ Dr, William H. EdMcational Resources Kanagemont Syatom t Chioagor 
Research Corporation, 1971* 

Cyert, Richard M, and James 0, March, A Bohavloral Theory of the Fi rm. 
Englewood CI if fa. New Jersey i PrentTcT-Hall/ Ino., 1963* 

Darlington, Richard B, and Jean F, Rom, "Assessing the Importance of 
Independent Variables in Nonlinear Causal Laws," American Education al 
Research Journal , 9(3) :449-462, Summer 1972. 

Davis, Martin. Computabillty and Unsolvablllty , New Yorkt McGraw-Hill 
Book Company, 1958, 

Blgerdf Olle J» Control systems iheory , New Yorki McGraw-Hill Book 
Company, 1967 » 

Etzionl, Amitai, Modern^ Organizations > Englewood Cliffs; New ^Ter^^yi 
Prentice-Hall, Inc., 1964. 

Evans, J, A. A Framework for the Eyolutlpnary Development of an Executi ve 
Infor m ation System^ Part 1/ Organizational Problem:>-Findlng . BedfordT" 
Massachusetts:" Mitre Corporation, 1970, (ED 047 729) 

- A Frarnework for the Evolutionary Development of an Executive 

Information System, Part 2t System Design, Implementation, and 
Evolution. Bedford, Massachusetts! Mitre Corporation i 1970. 
(ED 647 730) ^ 

Finn, James D, "institutionallEation of Evaluation/* Evaluation and 
"M^'N Fairfax, Virginia I Center for Effecting Educational Change, 
1968* 

Flament, c. Applipatipns of Graph Theory tp Group Structure » Englewood 
pliffs, New Jersey 1 Prentice-Hall, Inc., 1963. 

Forrester, aay. World Dynamioe , Cambridge, Massachusetts! Wright-Allen 
Press, Ino4, 1971* , 

Gephart, William J, Criteria for Methodological Adequacy for Research on 
■ Educational Change > Bethesda, Maryland^ ERIC, 1965* (ED Oil 146) 

Gephart, Milllam J, The Eight General Research Methodologies? A Facet 
Analysis of the Research Process > Bloomliigtoh, indianaj Phi Delta 
Kapa, 1969. (ED 052 237} 

Oideonse, Hendrik p* Eduoational Research and Development in the United 
States, Washington^ D, i National Center for Educational Research 
and Dev^^lopmenti U. S. Government Printing Of flee i. 1970, 

Gordon, Robert, "optimum Component Redundancy for Maximurft System Relia- 
bility,'* operations Research , 5i 229-243; 1957* 

Griffithii P#&i#l • peveloping Taxonomies of Organization al Sehavior 

\in: feducaiHdn ^' Hnal Report , Mew VorkV New York University ^ Aprils ' 
1968, (ED 021 339) 



31 



GriffithSi Daniel (ed,), poy(3 loping Taxpnpinies of prganizatipnal Bohavlor 
in Educational^ Adininis'trat|^^ Chicago i Rand McNally and Company, 1969, 

G\iba, Egon 0* Methodological Strategies for Educational Change ^ Bethosda, 
Marylandi BRIC/ 1965, (ED Oil 404) 

Habenatein, Robert W» (cd.). Pathways to Datai Field MethpdjB for Studying 
pngping Sopial. Organizations / ChicagoV Aidine Publishing Company/ 
1970 • 

Haberstrohi Chadwick J« "Organissational Design and Systems Analysis/* 
James Gt March (edi)i Handbook of Organizations , Chicagoi Rand 
McNally and company, 1965 # 

Haggart, Sue A. (ed.) . P rpgram^^Budgeting for School District Planning « 
Englewdod Cli.ffs, New Jersey i Educational Technology Publications, 
1972. 

Halpin, Andrew Admtnistratiye Theory in Edupation t New Vorki The 
MacMillan Company, 195 8 ♦ 

. Theo r y and Research in Administration . New Vorki The * 

MacMillan Company, 1966. 

Harary, Frank. "Graph Theory and Group Structure,*' R. Duncan LUce, Robert 
R, Bush, and Eugene Galanter (editors), Readings in Mathematical Psy^ 
ohology, Vol. II. New York t John Wiley and sons. Inc. , 1965. 

Harary, Prank, Robert Z. Norman, and Dorwin Cartwright. Structural Models . 
New Vorki John Wiley and Sons, Inc*, 1965. 

Hills, R. Jean. Toward A Science of Organigatio*> Eugene, Or egon rUniver 
sity of Oregon Press, 1968 * 1 

Jones, J* Christopher. Design, Methodsi ' Seeds of Human Futures; London t 
Wiley-Interscience, 1970. 

Kaplan, Abraham. The Conduct of Inquiry , San Francisco t Chandler Pub- 
lishing company, 1964, 

Keeney, M^ 0., H, E, Koenig, and Semach. State^Spap^ Models of Educa* * 
tipnal Institutions . East Lansing, Michigani Division of Engineering 
Research, Michigan State University, 1967. ! 

Kleene, Stephen Cole. Mathematical Logic , New Yorkt John Wiley and Sons, 
Inc. , 1967, 

. Klein, S* J. Burry, D, A, Churman, and Mi A. Ne^d^au* Evaluation Work* * 
shop tt'jM Orientation . Monterey, Californiai GTB/MCGraw-Hill, 19^1 . 

lA^ssinger, Leon M, and Ralph W, Tyler (editors) . Accpuntability in Educa" 
tlon , Belmont, California » Wadsworth Publishing Company, Ino.^ 1971. 

iiittfirtiri Joseph A. Organizations t Structure and Behavior, Vol* !• New 
Vorkj John Wiley, and Sons, inc., 1969. 

^ ^ Or^nizationst Systems, Control and Adaptation, Vol. II . New 

Yorki John Wiley and Sons, Inc., 1969. * 



32 



Levlon, Roger E. National Institute of Education: Preltfajlnarv Plan for 
the Propoaod Inatttut a; Santa Monica » California i RAND Corporation, 
1971. (KD 047 leTT^ 

Marchi James G. (Ed.)» Handbook of Organizations > Chicago: Rand McNally 
/ and Company, 1965. 

and Herbert Ai Sliaoa. Organizatio ns. New York: John Wiley and 

Sons> Inc. , 1958, 

^^eadow8, Donolla H. et al* The Limits to Growth: A Report for the Club 
of RotneU Project on the Predicament of Mankind . New York: Universe 
Books, 1972. 

Mossarovic, M. d. , D. Macko, and Y. Takahara. Theory of Hierarchica l^ 
Multi*-level Syste ios. New York: Academic Press, 1970. 

Mlshkin, Ell and Ludwlg Braun. Adaptive Control SvsteW . New York: McGraw- 
Hill Book Company, Inc., 1961. 

Nash, Robert J. and Russell M. Agne. '^Career Education: ^Earning A Living," 
Phi Delta Kappan > 54(6) :373-378| February, 1973. 

Ogata, Katsuhiko. State Space Analysis of Control Systems . Englewood Cliffs, 
New Jersey: Prentice-Hall, inc., 1967. 

Organization for Economic Cooperation end Development. Mathetnatical Models 
' in Educational Planning . Paris: Organization for Economic Cooperation 
and Development, 1967. 

^. 

. , . Methods and Statistical Needs for Educational Planning . Paris: 

Organization for Economic Cooperation and .Development , 1967 . 

Pontryagin , L. S. et al . The Mathematical Theory of Optimal Processes . 
New York: John Miley and Sons, Inc. i ^1962. 

Price, James L. Organizational Effectiveness: An Ipventory of Propositions . 
Homewood, Illinois: Richard D. Irwln, Inc., 1968. 

Provus , Malcolm, Discrepancy Evaluation; For Educational Program Improve-^ 
tnent and Assessment * Berkeley, California: McCutchan Publishing 
Corporation, 1971. 

and G, Edward Lundln. ''Evaluation for Administrative Action,- 



Journal of Research and Development in Education . 3(A) :1**108, Summer 
T97pr ^ 

• ' " * i ■ . • • " ■ ' ■ , 

Roberaorti E. Wayne (ed.). Educational Accountabilit y Through Evaluation^ 
Englewood Cliffs, New Jersey: Educational Technology Publications, 
1971. 



^ KOai-A».v- V^ Decision Stroctuf^ for Educational 

i;;/ ? ' i3(iTl f fffilU^^^^ Urt 1 ve rs 1 ly of iU\ 1 1 f o ti\ I ;J , 196 3 . 



Systems . liv.tkv Icy , 



IC 



Rudwtck, Bernard H. Svatetns Analveis for Effective Planningt Principles 
and Cages . New Vorki John Wiley and Sons, Inc., 1966. 
" ' ' ' s 

Sanders, James R. and Blaine R. Worthen. "A Descriptive Sumraary of Frame- 
work for Planning Evaluation Studies," SRIS Quarterly > 5(1): 10-14, 
Spring 1972. 

Schultz, Donald 0. and James L. Melsa. State Func tions and Linear Control 
Systems . New YorkJ McGraw-Hill Book Company, 1967. 

Schutz, Richard E. "Advocacy and R&D in Education," Educationa l Researcher, 
2(1) J 3, January, 1973. 

Scriven, Michael et al. An Evaluation System for Regio nal Labs and R&D 
Centers . Washington, D.C.J USOE (NCERP\ 1971. 

Shannon, C. E. "A Mathematical Theory of Communication," Bell System Tech- 
nical Journal . 27j379-423, 623-656, 1948. 

and W. Weaver. The Mathematical Theory of Communication . Urboiia, 
Illinolsi University of Illinois Press, 1949. 

Sprlgle, Herbert. "Who Wants to Live on Sesame Street?" Young, Children. 
December, 1972. 

Stake, Robert E. "PACE Evaluation." Evaluation and "PACE" . Fairfax, 
Virglniai Center for Effecting Educational Change, 1968. 

Starr, Martin Kenneth. Product Deslt^n and Decision Theory . Englewood 
Cliffs, New Jersey; Prentice-Hall, Inc., 1963, 

Stepp, Ermel, Jr. An Evaluation Model for a Regional Educational Service Agency » 
Construotion in a Product Development Setting . A paper presented in a 
symposium on a product evaluation model at the annual meeting of the 
American Educational Research Association, New Orleans, Louisiana, 
February, 1973. 

^ , Planning Educationa l Sy stems control <' A State-Space Model 

of Strategic Factors . Ann Arbor: University Microfilms, 1971. 

Stufflebeam, Daniel et al. ^^ft^^n for Evftluatlnf> R&D Institutions and 
Programs . Washington, D. C. t USOE (NCERD) , 1971. 

. Educational Evaluation and Doclslon Making * Itasca, Illlnolst 
P* B. Peacock Publishers, Inc., 1971. 

Taylor, Donald W. "Decision Making and Problem Solving*" Handbook of 
Organizations . James 0. March (editor). Chicago { Rand McNally and 
Company, 1965. 

A Comprehensive Theory of Cost-Effectiveness. VUIU- 
4^^^ Research for Better Schools, Inc., 1970. (ED 040 503) 

iERjqliiiii^ 



. 34 



Traci, George S. ''An Overview of Optimal Control Theory Applied to Educa- 
tional Planning*'* Paper read at the American Educational Research 
Aasociation, Los Angeles » California* 1969* (ED 030 189) 

\ 

TyjLftr» Raliih W. (ed.). Educational Evalua^tioni New Roles > New Means * 
The Sixty-eighth Yearbook of the National Society for the Study of 
Education, Chicagoj The National Society for the Study of Education, 
June, 1970, 

USOE • Testi ng and Further Development of an Operational Model for the 

Evaluation of Alternative Title I (ESEAy Projects i Washington, D, C* s 
Office of Education (DHEW) , 1968* (ED 032 757). 

Von Neumann, John, "The General and Logical Theory of Automata," Cerebral 
Mechanisma in Behavior * New York: John Wiley and Sons, Inc., 1951i 

"Probabilistic Logics and the Synthesis of Reliable Organisms 



from Unreliable Components," Automata Studies *. Princeton, New Jerseys 
Princeton University Press, 1956. § 

Webb, Eugene et al. Unobtrusive Measures: Non-reactive Res earch In the 
Social Sciences * Chicago j Rand McNally and Company, 1966* 

Weiner, Norbort, Cybernetics*, Coimnunication and Control in the Animal 
and the Machine * New York? John Wiley and Sons, Inc., 1948, 

Itie Human Use of Human Beings? Cybernetics and Society , New 



York? Doubleday and Company, Inc, , 195A, 

Wheeler, Harvey and Alexander King, "The Totality of the World Problematique 
Must Now Be Addressed," Center Report , *S(4) ?26-29 , October, 1972. 

Morthen, B, R* and J» R, Sanders, Educational Evaluation t Theory and 
Practice * Worthington, Ohio? Charles A* Joney (in press) , 

Young^ Stanley * Management: A Systems An^ly^is * Olenview, Illinois t 
Scott, Voresman and Company, 1966, 

Zemach, Rita. A State S pace Model fo r j^^^ Allocat ion In Higher 

Education , East Lansingj Division of Engineering Research, Michigan 
State University, 1967, 



